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HIGH-SPEED LINE INTERFACE FOR NETWORKING DEVICES 
RELATED APPLICATIONS 
This application claims priority under 35 U.S.C. 120 as a continuation-in-part of U.S. 
Patent Application Serial No. 09/534,838, entitled "Bandwidth Division for Packet Processing," 

5 filed March 24, 2000, to Dyckerhoff et al., and U.S. Patent Application Serial No. 

(attorney docket no. 0023-0014), entitled "Bandwidth Division for Packet Processing," filed 
January 2, 2001, to Dyckerhoff et al. The contents of both applications are hereby incorporated 
by reference. 

BACKGROUND OF THE INVENTION 
10 A. Field of the Invention 

The present invention relates generally to networking and, more particularly, to a high- 
speed line interface for networking devices. 
B. Description of Related Art 

A data communications network may be formed by interconnecting networking devices, 
15 such as routers and switches, through communication links. To accommodate links of different 
types and speeds, many networking devices include slots in which line interface cards may be 
inserted. Each line interface card converts signals from a respective link to packets that are 
routed or switched by the networking device and vice-versa. The line interface card may also 
perform some preprocessing on the packets before they are routed/s witched. The nature of the 
20 different types of communication links is such that, in many cases, a separate line interface card 
may need to be specially designed for each different type of link. 
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Problems arise, however, with line interface cards used with high-speed communication 
links. Such links may provide data at a faster rate than line interface cards can process or 
handle. This may result in a substantial reduction in data throughput or, worse yet, data loss. 
Even if the line interface cards are able to process the data at the rate it is being received, 
5 appropriate switching/forwarding modules need to be available to receive packets from these 
line interface cards. These problems become more significant as data communication links are 
becoming increasingly fast and the number of links connected to networking devices is 
q increasing. 



Systems and methods, consistent with the present invention, address this and other needs 
by providing a high-speed line interface. The interface divides a single data flow into a plurality 
of data flows for parallel data processing. 



15 herein, a network device comprises a sprayer module, a plurality of preprocessing modules, a 
plurality of switching/forwarding modules, and a framer module. The sprayer module receives 
data packets and outputs the received data packets on a plurality of channels. The plurality of 
preprocessing modules processes the data packets received from one of the channels of the 
sprayer module. Each of the plurality of switching/forwarding modules receives data packets 

20 from a corresponding one of the plurality of preprocessing modules. And the framer module 
deserializes a stream of in-coming data onto a multi-line bus, extracts data packets from the 




Therefore, there is a need for a high-speed line interface for networking devices. 
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SUMMARY OF THE INVENTION 



In accordance with the purpose of the invention as embodied and broadly described 
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deserialized data on the multi-line bus, and transmits the extracted data packets to the sprayer 
module. 

Other implementations and concepts consistent with the invention are described. The 
invention is defined by the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a part of this 
specification, illustrate an embodiment of the invention and, together with the description, 
explain the invention. In the drawings, 

Fig. 1 is a block diagram of a generalized network device which may use the invention; 

Fig. 2 is a block diagram of one embodiment of a network device consistent with the 
invention; 

Fig. 3 is a block diagram of an I/O board used in the network device shown in Fig. 2; 
Fig. 4 is a block diagram of another embodiment of a network device consistent with the 
invention; 

Fig. 5 is a block diagram of a processing board and line interfaces shown in Fig. 4; 
Fig. 6 shows a flow diagram of how an in-coming data stream is processed, consistent 
with the invention. 

Fig. 7 shows a flow diagram of an out-going data stream is processed, consistent with the 
invention. 

DETAILED DESCRIPTION 
Systems and methods, consistent with the present invention, provide a high-speed line 
interface for networking devices. Such an interface may be used in networking devices, such as 
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routers and switches, for receiving data from, and transmitting data to, high-speed links, such as 
those lines carrying data at rates of 2.5 Gbit/sec, 10 Gbit/sec, and 40 Gbit/sec and more. In a 
preferred embodiment, the interface deserializes data from an incoming data stream onto a multi- 
line bus so that the data may be processed at a lower clock speed. Packets are extracted from the 
data on the multi-line bus and distributed among a plurality of switching/forwarding modules for 
processing. 

The following detailed description of the invention refers to the accompanying drawings. 
The same reference numbers in different drawings identify the same or similar elements. Also, 
the following detailed description does not limit the invention. Instead, the scope of the 
invention is defined by the appended claims and equivalents. 

EXEMPLARY APPARATUS 

Fig. 1 is a diagram of an exemplary network device 100 in which systems and methods 
consistent with the present invention may be implemented. Network device 100 provides a 
generalized view of systems that may implement the invention. More detailed systems are 
shown in subsequent drawings. 

As shown in Fig. 1, network device 100 includes controller 1 10, switching/forwarding 
module 120, and a plurality of I/O boards 130A-130N. While network device 100 may be a 
router or switch, it may also be any other type of network device that processes data packets 
received from one or more ingress links. 

Controller 1 10 is responsible for general system management functions for network 
device 100. Such functions may include system configuration, diagnostic, system status and 
monitoring, statistical gathering, external communications, and updating internal tables, such as 
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routing tables. Controller 1 10 may be implemented in hardware or software. While controller 
1 10 is shown as a separate component, it may be integrated into any of the other components of 
network device 100. 

Switching/forwarding module 120 switches or forwards data packets to the appropriate 
data paths. In one embodiment, switching/forwarding module includes hardware/software logic 
for interrogating data packets (or portions of the data packets) to determine their destination and 
causing the data packets to be forwarded to the appropriate data path according to a forwarding 
table. Switching/forwarding module may be implemented as a switch fabric or data crossbar and 
is preferably under the control of controller 110. In one embodiment, switching/forwarding 
module 120 receives data packets and forwards the data packets. In another embodiment, 
switching/forwarding module 120 receives portions of data packets (such as header information) 
and transmits instructions as to how data packets stored elsewhere should be forwarded. 

I/O boards 130A-130N are a plurality of i\f boards that interface external data 
communication links to switching/forwarding module 120. In a preferred embodiment, I/O 
boards 130A-130N are responsible for processing streams of data and extracting data packets to 
be sent to the switching/forwarding module 120. Each of the I/O boards 130A-130N may be 
customized to handle specific types and speeds of data communication links. 

Fig. 2 shows network device 200. Network device 200 includes controller 210, a 
plurality of switching/forwarding modules 220A-220D, and a plurality of I/O boards 230A- 
230N. 

Controller 210 provides similar functionality as controller 1 10, except that controller 210 
preferably controls a plurality of switching/forwarding modules instead of a single 
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switching/forwarding module and the flow of data to and from those switching/forwarding 
modules. Again, controller 210 may be implemented in either software or hardware and some or 
all of its functionality may be integrated into some of the other components of network device 
200. 

Each of switching/forwarding modules 220A-220D provides similar functionality as 
switching/forwarding module 120. While four switching/forwarding modules are shown in Fig. 
2, the invention may be used with fewer or more switching/forwarding modules. 

Each of I/O boards 230A-230N provides similar functionality as I/O boards 130A-130N. 
One difference shown in Fig. 2 is that each I/O board 230 contains a separate data path to each 
one of the plurality of switching/forwarding modules 220A-220D. One implementation of I/O 
board 23 OA is shown in greater detail in Fig. 3. While this implementation is shown for I/O 
board 230A, it may be used for any of I/O boards 230B-230N. 

As shown in Fig. 3, I/O board 23 OA includes receiver module 3 10A, transmitter module 
310B, framer module 330, sprayer module 340, desprayer module 350, a plurality of 
preprocessing modules 360A-360D, and a plurality of corresponding RAMs 370A-370D. 
Receiver module 3 10A and transmitter module 3 10B connect to framer module 330. Sprayer 
module 340 and desprayer module 350 connect to framer module 330 and to each of the 
preprocessing modules 360A-360D. Each of the preprocessing modules 360A-360D connect to 
respective RAMs 370A-370D and connect to respective switching/forwarding modules. In a 
preferred embodiment, each of the components and modules of I/O board 230A is integrated on 
a separate chip/module and the chips/modules are mounted on a single board. Alternatively, the 
components and modules may be all integrated onto a single chip. In other embodiments, the 
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functionality of the components and modules may all be integrated on one or more chips, which 
are mounted on one or more separate boards. 

Receiver module 3 10A and transmitter module 3 10B connect I/O board 23 OA to an 
ingress and egress link, respectively. In a preferred embodiment, receiver module 31 OA and 
5 transmitter module 3 10B include optics and circuitry to connect to high-speed optical links, such 
as SONET OC-48, OC-192, OC-768, etc. Such optical components may be very short reach 
(VSR), short reach (SR), intermediate reach (IR), long reach (LR), very long reach (VLR), single 
□ mode, and/or DWDM. Receiver module 3 10A and transmitter module 3 10B preferably do not 

Q 

,: J take a large amount of space (e.g., preferably less than 6 inches by 6 inches) or do not draw a 

in 

! ^ 10 large amount of power. Suitable modules are commercially available and are offered by optical 
vendors, such as Lucent. 

5: 

H For example, in one embodiment where the transmitter module connects to SONET 

u OC-192 links, transmitter module 3 10B may receive 16 streams of parallel data at 622 MHz and 

IJ 

O serializes the data into a single lOGbit/second stream and converts it to an optical signal at 1550 

M 

15 nm for transmission on a single mode fiber. Receiver module 3 10A may receive a single 
lOGbit/second stream, convert it from an optical signal into an electrical signal, then 
disinterleave the stream into 16 streams of parallel data at 622MHz. 

Framer module 330 operates as a framer to extract data packets from an in-coming 
stream of data and as a deframer to form an out-going stream of data from data packets. 
20 As a framer for in-coming data, framer module 330 receives an in-coming stream of data 

from receiver module 3 10A. The in-coming stream of data received by framer module 330 may 
be a single stream of data or may be multiple streams of data (e.g., 16 streams from receiver 
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module 31 OA, as described in the above example). Framer module 330 deserializes the in- 
coming stream of data (i.e., forms multiple parallel streams from a single stream or forms 
additional parallel streams from multiple streams). Framer module preferably has a multi-line 
internal bus corresponding to the number of streams to which the data has been deserialized. For 
5 example, framer module 330 converts 16 streams of data clocked at 622MHz to 128 streams of 
data clocked at 77 MHz. In this example, framer module 330 preferably has a 128-line bus for 
extracting data packets from the 128 streams of data. In one embodiment, to extract data 

□ packets, framer module 330 may perform framing (such as SONET framing to identify the 

3 1 

beginning and end of the packets) and other processing to prepare the data packets, such as 

in 

\ * 10 removing link layer overhead (such as SONET and HDLC overhead), descrambling, and error 

ail 

checking. 

]U As a deframer for out-going data, framer module 330 receives data packets and forms an 

l.JL 

i 'i out-going data stream. In a preferred embodiment, framer module 330 has a multi-line bus for 

Q 

□ processing the received data packets (e.g., 128-line bus). Framer module 330 identifies the 
15 beginning and end of data packets and processes the packets for transmission on an external 

communication link. Such processing may include adding appropriate link layer overhead (such 

as SONET and HDLC overhead), performing error detection calculations, and scrambling. 

Framer module 330 also serializes the data to form an out-going data stream. The out-going data 

stream may be a single stream of data or may be multiple streams of data (e.g., 16 streams for 

20 the transmitter module 3 10B, as described in the above example). In one embodiment, framer 

module 330 receives data packets on a 128-line bus clocked at 77MHz, processes the packets for 

transmission, and converts the data into 16 streams of data clocked at 622MHz. 

8 



# 

Attorney Docket No. 0023-0027 

Examples of implementations of a framer and deframer module are described in U.S. 
Patent Application No. 09/637,709, entitled "Systems and Method For Packing Data into a Data 
Register," filed August 15, 2000, to Padmanabhan et al. and U.S. Patent Application No. 
09/706,752, entitled "Systems and Methods for Generating a Reliable Clock for Reception and 
Data Recovery," filed November 7, 2000, to Padmanabhan et al. The contents of both 
applications are hereby incorporated by reference. 

Sprayer module 340 receives data packets from framer module 330 and transmits them 
across a plurality of data paths. In a preferred embodiment, sprayer module 340 contains a 
plurality of output channels or outputs, each coupled to one of the plurality of data paths to a 
switching/routing module. There are various ways that sprayer module 340 may select the data 
path on which each data packet is sent. For example, sprayer module 340 may use a 
predetermined hash algorithm, a fixed pattern, randomly, or based on some mechanism for load 
balancing. Sprayer module 340 preferably includes a mechanism, such as injecting delay or 
packet tagging, to avoid reordering of data packets as they emerge from their respective data 
paths. In one embodiment, sprayer module 340 receives data packets from a single framer 
module across a multi-line bus (e.g., 128-line bus). In other embodiments, sprayer module 340 
receives data packets from a plurality of framer modules, in which case bus lines are preferably 
allocated to each framer module for receiving data packets. 

Desprayer 350 receives data packets from multiple data paths (or input channels 
connected to the data paths). In one embodiment, desprayer 350 combines the data packets 
received from the plurality of input channels into a single stream on a multi-line bus (e.g., 128- 
line bus) coupled to framer module 330. 
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Examples of implementations of the sprayer module and desprayer module are described 
in U.S. Patent Application Serial No. 09/534,838, entitled "Bandwidth Division for Packet 
Processing," filed March 24, 2000, to Dyckerhoff et al., and U.S. Patent Application Serial No. 

(attorney docket no. 0023-0014), entitled "Bandwidth Division for Packet Processing," 

5 filed January 2, 2001, to Dyckerhoff et al. 

Preprocessing modules 360A-360D perform additional processing on the data packets 
before the data packets (or portions of the data packets) are sent to the respective 
switching/forwarding modules. Such additional processing may include removing Layer 2 
overhead, extracting header information, and preparing the data packets for storage in memory. 
10 Preprocessing modules 360A-360D also perform memory management in storing data packets 
(or portions of data packets) in corresponding RAMs 370A-370D. Preprocessing modules 
360A-360D may perform similar functions on data packets received from switching/forwarding 
modules 360A-360D, as well as other functions, such as packet encapsulation and header 
modification. 

15 RAMs 370A-370D comprise memory for storing data packets and other related 

information. RAMs 370A-370D are preferably synchronous DRAMs. In other embodiments, 
RAMs 370A-370D may comprise other forms of memory. While RAMs 370A-370D are shown 
as separate components from preprocessing modules 360A-360D, they may be integrated into 
the same physical component. 

20 Fig. 4 shows another embodiment of a network device using the invention. Network 

device 400 includes similar components as contained in network device 200, except that network 
device 400 includes processing board 410 and line interfaces 420A-420B. Processing board 410 

10 
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and line interfaces 420A-420B provide an alternative structure for interfacing communication 
links to a network device, consistent with the invention. 

Processing board 410 and line interfaces 420A-420B are shown in greater detail in Fig. 5. 
The components of processing board 410 are similar to those components shown in Fig. 3 having 
the same reference numerals. Sprayer module 500 performs similar functions as sprayer module 
340, except that sprayer module 500 is connected to more than one frame module. Accordingly, 
sprayer module 500 preferably allocates a portion of its input lines to receiving data packets 
from one of the framer modules (e.g., framer module 426A) and the remaining input lines to 
receiving data packets from the other framer module (e.g., framer module 426B). While two 
framer modules are shown connected to sprayer module 500, more than two framer modules 
may be connected. In such a case, the appropriate number of input lines is preferably allocated 
to each of the connected framer modules. In addition, sprayer module 500 has logic for 
determining which data packets to process (e.g., spray) from framer module 426A and framer 
module 426B (or whatever framer modules are connected to the input of sprayer 500). In one 
embodiment, sprayer 500 contains a FIFO and data packets received from either framer module 
are added to the FIFO. Sprayer 500 processes the data packet that was added to the FIFO 
earliest. 

Similar modifications and adjustments are preferably made to desprayer module 510. 

For example, desprayer module preferably maintains address information for each of the framer 

modules (or line interfaces) connected to desprayer 510. Certain output lines are allocated to 

each of the connected framer modules. When desprayer 510 receives data packets, it outputs the 

data packets to the appropriate framer module on the corresponding output lines. 
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Line interface 420A and 420B are similar and contain similar components. These 
components are similar to those shown in Fig. 3. The components are preferably compatible and . 
support the appropriate type and speed of communication link for which it was designed. 

EXEMPLARY METHODS 
5 Exemplary methods consistent with the invention are now described. These methods 

may be described in connection with the exemplary apparatus described above or may be carried 
out by other apparatus. 

□ Fig. 6 shows a flow diagram of how an in-coming data stream is processed, consistent 

& 

; 3 

'"'"4 with the invention. A receiver module receives a single data stream (step 610). The single data 

j.* 10 stream is deserialized onto a multi-line bus operating at a lower clock speed than the receiver 
■ ™! module (step 615). Data packets are extracted from the data carried on the multi-line bus (step 

j»n 620). The data packets are sprayed across a plurality of data paths for processing. For example, 

i: s? 

IJL. 
J' ™ 

p one of a plurality of switching/forwarding modules may be selected for reach data packet (step 

1 ,i 

I; l£ 

Q 630). For each path selected (steps 640A-640M), the data packets are stored in RAM (steps 

n 

15 650A-650M) and transmitted (or at least a portion of the data packets) to the respective 

switching/forwarding module (step 660A-660M). 

Fig. 7 shows a flow diagram of an out-going data stream is processed. Data packets are 

received from a plurality of switching/forwarding modules (step 710). The data packets are 

carried on a multi-line bus and processed for link transmission (step 720). The data is serialized 
20 to form a single data stream (step 730) and transmitted from the transmitter module to the 

external communication link (step 740). 
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CONCLUSION 

Systems and methods, consistent with the present invention, provide a high-speed line 
interface to provide sufficient processing and bandwidth without compromising performance. 

The foregoing description of preferred embodiments of the present invention provides 
illustration and description, but is not intended to be exhaustive or to limit the invention to the 
precise form disclosed. Modifications and variations are possible in light of the above teachings 
or may be acquired from practice of the invention. The scope of the invention is defined by the 
claims and their equivalents. 
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